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We use high quality echelle spectra of 24 QSOs to provide a calibrated mea- 
surement of the total amount of Lya forest absorption (DA) over the redshift range 
2.2 < z < 3.2. Our measurement of DA excludes absorption from metal lines or the 
Lya lines of Lyman limit systems and damped Lya systems. We use artificial spectra 
with realistic flux calibration errors to show that we are able to place continuum levels 
that are accurate to better than 1%. When we combine our results with our previous 
results between 1.6 < z < 2.2, we find that the redshift evolution of DA is well de- 
scribed over 1.6 < z < 3.2 as A{1 + where A = 0.0062 and 7 = 2.75. We detect 
no significant deviations from a smooth power law evolution over the redshift range 
studied. We find less H I absorption than expected at z = 3, implying that the UV 
background is about 40% higher than expected. Our data appears to be consistent 
with an H I ionization rate of L ~ 1.4 x 10 
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1 INTRODUCTION 

The mean optical depth of the H I Lya forest observed 
in the spectra of high redshift QSOs is one of the main 
pieces of information on the physical state of the intergalac- 
tic medium (IGM). This is because the optical depth of the 
Lya forest (r e s) is sensitive to the combination of a wide 
varie ty of effects that w e can collect under two main head- 
ings iRauch et alJll99^) . First, r e g is sensitive to all the fa- 
miliar parameters of the cosmological model, including Qa, 
fi m , fib, the Hubble parameter and the parameters that 
describe the primordial power spectrum of density fluctu- 
ations. These parameters determine the density of hydrogen 
per unit length, the conversion from Mpc to wavelength in a 
spectrum, and the spatial variations of the density. The sec- 
ond set of parameters are astrophysical, rather than primor- 
dial, and they determine the ionization and thermal state of 
the low density hydrogen. The IGM is highly photoionized 
by ultraviolet photons from early stars and AGN. The r e g 



is then sensitive to the evolution of the intensity and spec- 
trum of the UV background, or UVB. The energy input per 
photoionization, and the competition between photoheating 
and the cooling from the adiabatic expansion together give 
the temperature of the low density IGM, an output rather 
than an input parameter. 

Over the last decade numerical hydrodynamic simula- 
tions of the IGM have steadily improved in accuracy. We can 
now make artificial QSO spectra directly from the full hy- 
drodynamical simulations and measure the statistical prop- 
erties of the Lya forest absorption in those spectra. As ex- 
pected, we find that the absorption in the artificial spectra 
depends on the co mplete set of cosmo logical and astrophysi- 
cal pa rameters. In lTvtler et alJ J2004L T04b) and lJena et alJ 
J2005L J05) we showed how we can choose sets of input pa- 
rameters for simulations that give artificial spectra that are 
statistically equivalent to the largest and best samples of 
real spectra. We can now use the simulations to decode the 
IGM. 
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When we match simulations to real QSO spectra we 
obtain joint constraints on the full set of cosmological and 
astrophysical parameters that we input to the simulations. 
We do not obtain constraints on individual input parame- 
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ters, except when we fix all the many other parameters at 
values obtained from other observations. 

We find that the statistical properties of the Lya for- 
est are highly sens i tive to many of th e input parameter s 
jTvtler et all 120041 : iBofton et all 120051: Ijena et alj 120051) . 
When we compare to calibrated real spectra, we can expect 
to obtain joint constraints on sets of parameters that are 
competitive with the best measurements from other types 
of observations. This motivates us to improve the accuracy 
of the measurement of the IGM. 

We also find that the comparison between numerical 
simulations and real spectra of the Lya forest provides 
the most accurate measurements of the intensity of the 
UVB iRauch et alJl997tlTvtler et all2004l ; |jena et all2005t 
iBolton et al.ll2005l) . 

We have found that two statistics in particular provide 
a good summary of the Lya forest. One is the effective opti- 
cal depth r c ff, and the other some measure of the clumping 
and temperature of the gas, such as the line width distri- 
bution, or the power spectrum of the QSO flux. In T04 
we measured r e g to high precision over the redshift range 
1.6 < 2 < 2.2. The aim of this paper is to extend the red- 
shift range over which we can make detailed comparisons 
between simulations and data by providing a calibrated and 
precise measurement of the H I Lya forest opacity over the 
redshift range 2.2 < z < 3.2. 

1.1 Previous Work 

There has been extensive previous work dedicated to mea- 
suring the total amount of abs orption in the Lya f orest, sum- 
marized in part by T04b and iMeiksin fc White! <2004l) and 
the references therein. Many of t hese m easurements appear 
to differ, but IMeiksin fc White! &2004) showed that much, 
but not all, of the disagreement between some measurements 
was caused by differences in treating errors. T04b discuss 
other differences that remain. 

Although we have had spectra of the Lya forest since 
1972, it is only recently that we have had simulations of the 
quality to match highly accurate measurements of the mean 
amount of absorption. 

The mean absorption is hard to measure for three rea- 
sons discussed at length in T04b: the continuum level, metal 
lines and sample size. 

To measure the amount of absorption we must first 
guess the continuum prior to the absorption. This is rela- 
tively easy at z ~ 2, hard at z ~ 3 and very hard at z > 4 
where there is little if any unabsorbed continuum remaining 
in the Lya forest. T04b dealt with the continuum level by 
making and fitting artificial spectra that looked similar to 
the real spectra. They saw and fitted the emission lines in th e 
Lya forest of each individual spectrum £ n ytler e ^ al.||2004[). 
These lines vary a lot from QSO to QSO (iTvtler et alJl20ol: 
ISuzuki et af]l2005D . Using the artificial spectra we were able 
to show that their continuum level was accurate to approx- 
imately 0.3%, after correction, and averaging over the Lya 
forest of 77 QSOs. 

The simulations that we compare to the Lya forest spec- 
tra typically lack the resolution and physics required to give 
realistic metal absorption lines and Lya lines from regions 
with column densities log Nhi> 17.2 cm -2 We then need a 
prescription for dealing with metal lines and strong Lya lines 



in the Lya forest. Some measurements ignore these lines, 
while others subtract some or most of them. At z = 1.9 T04b 
showed that the metal lines contributed 15% and strong Lya 
lines 7% of the absorption in the Lya forest. However, they 
each contributed about the same amount to the total vari- 
ance of the absorption as did the Lya absorption in the low 
density IGM. 

The last requirement for an accurate measurement of 
the mean amount of absorption in the Lya forest is a large 
sample, ideally at least tens of QSOs. It had long been noted 
that there is conspicuous variation in the amount of Lya 
forest absorptio n from QSO to QSO JCarswell et alJll982l : 
iKim et ai1l200ll) , and T04b showed that the amount of vari- 
ation on scales of Az = 0.1 (121 A in the observed frame) is 
consistent with large scale structure for a primordial spec- 
trum of perturbations with slope n = 0.95, and present am- 
plitude erg = 0.9 

Following lOke fc KorvcanskvHl982T) we define DA(z) = 
1 — F(z), where F(z) is the observed flux divided by the con- 
tinuum level, and F(z) is the mean over many spectra at a 
given redshift. T04b found that DA(z = 1.9) = 0.151±0.006 
including all absorption at rest frame wavelengths 1070 - 
1170 A towards 77 QSOs. The error here is partly from 
the continuum level, and partly from the sample size. T04b 
estimated the metal line absorption from wavelengths be- 
tween the Lya and C IV emi ssion lines, from both their own 
spectra and from spectra of ISargent et alJ 1^988). They es- 
timated the strong Lya lines from the statistics of such lines 
in other spectra. When they subtracted both the metal lines 
and strong Lya lines the DA drops to 0.118±0.010. T04b es- 
timated that approximately 5 ideal spectra, all at the same 
Zem with no continuum errors, and no metal lines or strong 
Lya lines would give DA with an error of 0.01 at a single 
redshift, z = 1.9. High resolution spectra might approach 
this li mit. 

In lJena et alj i2005l) we presented a set of 40 fully hy- 
drodynamic simulations of the IGM at z = 2. We derived 
scaling laws that related the parameters of simulated spectra 
to the parameters that we input to the simulations. When 
we apply the scaling laws to a simulation, we can predict the 
output parameters to higher accuracy than the typical mea- 
surement error in real spectra. We were able to predict the 
most common line width (b- value) to 0.3 km s _1 and the r e ff 
to 0.0027, both approximately a factor of four smaller than 
the measurement errors in the real spectra. In this paper we 
address the need for improved measurements. 

1.2 Our Approach 

We apply the methods of T04b to make a calibrated mea- 
surement of DA at 2.2 < z < 3.2. The basic idea is that 
we will ensure that our continuum fitting is unbiased by si- 
multaneously fitting our real data and artificial spectra that 
have been carefully prepared to exhibit the types of errors 
shown in real spectra. The hope is that any systematic er- 
rors in our continuum fitting will manifest themselves in our 
continuum fits to both the real data and the artificial data. 
We can then measure them in the artificial data and apply 
the appropriate corrections to our real data. 

We will generally follow the details of T04b, with some 
specific exceptions. Here we made artificial continuum and 
emission line spectra using principal component spectra, 
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Figure 1. The number of HIRES QSOs which have complete 
Lya forest coverage in different redshift bins 

rather than real HST spectra ijSuzuki et, al.ll200Rll . We made 
the Lya forest absorption from randomly placed Voigt pro- 
files with parameter distribution functions taken from the 
literature, instead of using a simplified model of the IGM 
to produce the Lya forest absorption. In addition, we added 
metal and strong Lya lines to the artificial spectra. However 
the main difference is that we now use HIRES spectra with 
8 km s _1 resolution in place of the 250 km s" 1 resolution 
spectra that we used in T04b. The higher resolution comes 
with many times more photons per A and allows us to place 
accurate continua at higher redshifts. 



2 DATA SAMPLE 

We use a collection of QSO spectra obtaine d with the 
HIRE S spectrograph on the Keck telescope iVogt et alJ 
Il994l) . These spectra were collected between 1994 and 2004, 
for a variety of programs. The 24 QSOs that we use in this 
paper were selected from among our HIRES spectra for the 
following reasons: (1) they have significant coverage for Lya 
lines with 2.2 < z < 3.2, (2) they have SNR 8-70 per 2.1 
km s - j with a mean of 20 and (3) we were able to perform 
high quality flux calibration of the QSO spectra. The list of 
spectra we use in this paper is given in Table 1. 

The spectra were all obtained with the original Tek- 
tronix 2048 x 2048 24 micron pixel CCD in HIRES up until 
August 2004. We used Tom Barlow's makee package to ex- 
tract the CCD images and apply the wavelength calibration. 
The individual exposures wer e flux calibrated and combined 
via the procedure described in lSuzuki et alJ <l2003l) . We mea- 
sured the redshift of each QSO from the estimated peak of 
the Lya emission line, which is given in Tabled as z em (e.g. 
Zom is not the systemic redshift of the QSO). 

A histogram of the number of different QSOs that con- 
tribute to each Az = 0.1 redshift bin is shown in Figure 
□ 

3 ARTIFICIAL SPECTRA 

We attempted to make artificial spectra that mimic real 
spectra in every important way, including emission lines, 
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cosmic ray hits, echelle blaze, and flux calibration errors. 
For each real spectrum, we made four artificial spectra with 
the same redshift and noise properties and various absorp- 
tion lines. 

We made the unabsorbed continuum shape, including 
emission li nes with the princ ipal component spectra de- 
scribed bv ISuzuki et alJ ll2005l) . The artificial spectra have 
a wide variety of shapes, and include realistic emission lines 
between Lya and Ly/3. The exact shape and strength of the 
emission lines was different for each artificial spectrum. 

We made the H I absorption from discrete lines, with 
the line distribution functions given in iKirkman fc Tvtlerl 
lll997l) . The artificial spectra used in this paper have lines 
of all column densities, 10 10 < Nhi < 10 18 cm -2 , and we 
placed lines at random redshifts, from the z cm listed in Table 
1, down to zero redshift. 

If a real spectrum had a DLA with log Nm> 10 19 ' 5 
cm -2 , we added a line with the same log Nhi at the same 
wavelength to all the accompanying artificial spectra. 

With each H I absorber, we also added the strong dou- 
blet absorption lines of C IV, Si IV, and Mg II to the artificial 
spectrum. We held the H I/X column density ratio constant 
for each metal ion, and the width of each metal absorber was 
calculated by assuming that the H I b values were entirely 
thermal. This resulted in an artificial metal forest that was 
superimposed on the H I forest, which made the artificial 
spectra look more realistic when inspected closely. 

The artificial spectra used in this paper were generated 
differently than the spectra we used for the same purpose in 
T04b. The spectra in T04b were generated via a toy model 
of the IGM that mimicked the large scale structure, but we 
did not add metal lines of the Lya lines of Lyman limit 
systems. 

We added noise to the artificial spectrum, and at- 
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tempted to match the approximate SNR level of each real 
spectrum. We based the noise levels in our simulated spec- 
tra upon the estimated error estimates in the real echelle 
spectra. The resulting artificial spectra have SNR similar to 
their real spectra except for three of the five with SNR > 45, 
where the artificial have a SNR too low by approximately 
1.5. 

We also added a blaze effect to the artificial noise lev- 
els to simulate the increased SNR obtained at the center 
of each echelle order. Furthermore, we added small fluxing 
errors, by offsetting different echelle orders by the blaze func- 
tion multiplied by a Gaussian random deviate with a = 2%, 
which is larger than the expected fluxing errors in the data 
JSuzuki et alj|2003ft . In Figure [2] we show an example of ar- 
tificial spectra, below the real spectra they approximate. 

Although we see differences between our artificial and 
real spectra, they do not concern us. Since we placed the Lya 
lines at random redshifts, the artificial spectra lack large 
scale structure. The artificial spectra also show more total 
absorption than real spectra, generally about 5% more total 
absorption over the redshift range 2.4 < z < 3.0. As we show 
in the next section, we are able to fit continua very well for a 
wide range of total absorption, so we do not believe that the 
minor differences between our real spectra and the artificial 
ones have significantly changed our results. 
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Figure 2. Example of our data, our continuum fits, and the arti- 
ficial spectra we used to verify our continuum fitting ability. The 
top panel shows the spectrum of Q 1243+3047 along with the in- 
dividual continuum fits of our two best fitters. The bottom panel 
shows one of the four artificial spectra that we made similar to 
the Q1243+3047 spectrum. Q1243+3047 is representative of the 
spectra at the top end of the SNR distribution for spectra used 
in this paper. The lowest major tick mark is the zero flux level. 
We show rest wavelengths 1070 - 1170 A. 



4 CONTINUUM FITTING 

Four undergraduate authors, SH, KJ, CM, and GS, took 
a training program to fit QSO continua. They fit artificial 
QSO spectra that were not matched to any specific QSO. 
These spectra had a variety of emission redshifts, SNR, emis- 
sion line profiles, and flux calibration errors. The four all fit 
the same spectra, and after they completed a few spectra, 
we revealed the true continuum level and we discussed their 
fit. Within a few weeks two of them were able to fit continua 
as well as any of us. 

After this training completed, we asked them to fit the 
real and matched artificial spectra. We provided spectra in 
sets comprising one real spectrum and two artificial ones 
matched to that real one. Each fitter was given the same 
copy of the real spectrum, but different versions of the arti- 
ficial spectra. We did not reveal which was the real spectrum 
in a set. 

The results indicate that the two best fitters were ex- 
cellent. The other two fitters were less accurate, and more 
importantly, occasionally had made large fitting errors. Thus 
for the measurement of DA, we used the average continuum 
of the two best fitters, and do not discuss the results of the 
other two fitters any further. 

The standard deviation of the continuum fit errors per 
spectral segments of length Az = 0.1 is 1.2%. We fit a 
total of 96 artificial spectra, four per QSO (two per fitter 
per QSO), and there were a total of 275 segments of length 
Az = 0.1 in these artificial spectra. Averaged over all 275 
segments, the continua of the two best fitters were above the 
true continua by 0.29 %. If the fits were unbiased, and the 
errors per segment were uncorrelated we would expect the 
bias to be 1.2/^275 = 0.07 %. As in T04b we have measured 
a small bias. 

In Figure |3 we show a weak correlation between the er- 



ror in the continuum fit to the artificial spectra and the mean 
amount of absorption in a spectral segment of length Az = 
0.1. We fit this correlation as bias B = 0.0098 - 0.0249DA 
and we corrected all our real continua using this fit to re- 
move the trend. After this correction when we average over 
all artificial spectra there is no remaining bias. All the data 
on the real HIRES spectra that we give in the paper have 
had this correction applied. We followed a similar procedure 
in T04b. After removing the bias associated with the mean 
flux of each spectral segment, we see no correlation between 
the error in the continuum fit to the artificial spectra and 
their SNR. We have not measured whether the bias varies 
from object to object, or as a function of z. 

Based upon our ability to continuum fit artificial spec- 
tra, we conclude that errors in continuum placement are not 
a significant source of error when measuring DA in high res- 
olution, moderate SNR spectra at z < 3.0. 



5 MEASUREMENT OF THE MEAN FLUX 

To avoid confusion between multiple Lyman series lines, we 
restrict our analysis to the region between the Lya and Ly/3 
emission lines of each QSO. To avoid continuum fitting prob- 
lems associated with rapidly changing emission line profiles, 
and possible contamination from the proximity effect, we 
further restrict our measurement of DA to the rest frame 
wavelengths 1070 - 1170 A. 

5.1 Removal of LLS absorption 

Because many of our objects were originally observed as 
part of our program to measure the primordial deuterium 
abundance, which can only be measured in LLS (including 
DLAs), our data contains more LLS absorption than would a 
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Figure 3. The difference between the fit continuum level and 
the true continuum level for each Az = 0.1 segment in the ar- 
tificial spectra. We plot this difference against the mean DA in 
each spectral segment. There is a weak trend with the amount 
of absorption, which we fit with the solid line. There are more 
points on this plot than we have in our real data, because we fit 
four artificial spectra for each real spectrum in our analysis. Note 
that the magnitude of the effect is quite small. 

completely random sample. This prevents us from removing 
the LLS absorption statistically, as we did in T04b. To over- 
come this problem, we have masked out all regions of each 
spectrum containing Lya absorption associated with identi- 
fied LLS. By mask, we mean that the pixels were marked as 
being unusable, and were not used in any further computa- 
tions. In practice, our LLS identifications are probably not 
complete, but we believe that we identified and masked all 
absorbers with Nhi > 10 19 cm -2 . 

If the QSO was originally observed as part of our pri- 
mordial D/H program, we also masked out any metal lines 
that might be at the known redshift of the targeted LLS. All 
wavelengths within 2000 km s' 1 of an H I, C IV, Si IV, C III, 
Silll, C II, or Sill transition at the D redshift were masked. 
The transitions were masked based solely on the redshift, 
the transition rest wavelength, and the fact that there is 
metal absorption associated with the system in which we 
had searched for D. No attempt was made to fit the metal 
absorption. 

5.2 Removal of metal line absorption 

We have not attempted to identify and mask individual 
metal lines in the Lya forest. While many of the spectra 
used in this paper have enough SNR to identify some of the 
absorption in the Lya forest, manual removal of metal ab- 
sorption is likely to be very incomplete, and we will not know 
how much absorption was missed. Instead, we will use the 
method described in T04b, and subtract the metal absorp- 
tion statistically. In this section we use the notation from 
T04b, summarized in Table 1 of that paper. Briefly, DM 
refers to the amount of absorption from metal lines alone, 
and DM4 refers to the DM from metal lines listed in Table 
3 of SBS88 averaged into bins of size Az — 0.1. 

We have measured the amount of absorpti on from metal 
lines in spectra published for 52 QSOs in ISargent et alJ 
l|l98Sl SBS88). We previously did this in T04b §8.1 for 26 
QSOs with 1.7 < 2 cm < 2.3. We now add the remaining 
QSOs listed in SBS88, to cover 1.7 < z cm < 3.54. We sum 



the equivalent widths of all the metal lines listed for the 52 
QSOs in Table 3 of SBS88 from rest wavelengths 1225 - 1500 
A. We group the lines in bins of length 121.567 A in the ob- 
served frame, corresponding to Az = 0.1 for Lya. In T04b 
we called these DM4 values. We now have 354 DM4 val- 
ues, with a mean of 0.0191 ± 0.0017 and a(DM4) = 0.0312, 
both slightly larger than the values (mean 0.0167 ± 0.0022, 
a = 0.0274) in T04b. The mean observed wavelength is now 
4764.4 A, compared to 4124.8 A in T04b. 

We attempted to remove all absorption lines from sys- 
tems that appeared to be associated with the QSOs. These 
systems produce large BAL like lines that are concentrated 
in certain emission lines, including Si IV, N V and O VI. 
The Si IV and especially the N V lines can contribute a lot 
to the DM estimate. However, the lines of these associated 
systems will have little effect on the total metal absorption 
in the DA region because O VI is excluded. We found six 
QSOs with conspicuous strong associated N V absorption 
that was responsible for many of the largest DM measure- 
ments of any segments in the sample. We also removed all 
lines from systems with /3 = v/c < 0.01, corresponding to 
velocities within 3000 km s _1 of the QSO. This value is large 
enough to remove most associated systems, without remov- 
ing too many intervening systems. This criterion removed 
Si IV from 6 additional QSOs, and a few C II and Si II 
lines. We also removed the occasional Galactic Ca II at zero 
redshift. After removing these absorption lines, the mean 
DM decreased 18% to 0.0157 ± 0.0013 and the standard de- 
viation decreased 21% to o(DM4) = 0.0248. 

Following T04b, we re-fit the DM4 values as a function 
of wavelength in the rest frame of the QSO A r and observed 
wavelength A 

DM5(A r ) = 0.01564 - 4.646 x 10~ 5 (A r - 1360), (1) 
and 

DM6(A ) = 0.01686 - 1.798 x 10~ 6 (A o - 4158). (2) 

(The slope of DA/6(Ao) was erroneously listed as 7.136 x 
10 _5 % in T04b Eqn. 13, it should be 7.136 x 10 _4 %). These 
fits supersede those given in T04b, both because the sample 
is twice as large, and because we did not remove associated 
systems in T04b. Note that here we give the DM as absolute 
values, while in T04b we gave the DM values in percentages. 

The removal of the associated systems has no significant 
effect on the intercepts, but a large effect on the slopes, 
because the N V lines concentrate near the minimum A r 
that we used from SBS88. Removing the associated systems 
without enlarging the sample causes a slight decrease in the 
slope with A r while increasing the sample has no additional 
effect. For A half the decrease in the slope comes from the 
removal of the associated systems and the other half from 
the enlargement of the sample. 

We want DM as a function of both A and A r . We see 
a clear trend of DM increasing as A r decreases, but no sig- 
nificant trend with A , and hence no strong evolution with 
z cm and Zabs- The tendency for DM to rise with falling A r 
is hard to see in plots, but appears to come from a smaller 
fraction of segments with no absorption lines at lower A r . 

We choose to correct each bin, from Kast and HIRES, 
by the DM for its A assuming it is at A r = 1120 A. The 
DM values range from DAf(1070) = 0.0291, to L>Af(1120) = 
0.0268 in the center of our A r range, to DM(1170) = 0.0245. 
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In T04b we used DM3 = 0.023 ± 0.005 for all segments. 
We now use £>M(1120) = 0.0268, for all segments, and we 
simultaneously correct for the slight trend with Ao given 
by Eqn. [5] At the mean A of the Kast sample we mea- 
sure DM(3525) = 0.01799 while for the HIRES sample 
DAf(4498) = 0.01624, both at the mean A r of the SBS88 
sample: 1357.2 A. We apply the A correction by multiply- 
ing by r ef f (A )/r c ff (4764.4 A), where 4764.4 A is the mean 
A of the SBSS88 sample. For example, we calculate r e g at 
4498 A, to be 1.03 x 0.02715 cor r espon ding to DM = 0.0276. 
As we explained in Ijena et al.l J2005f) . we subtract the r e g 
values corresponding to the DM from the r e s corresponding 
to the DA. We do not directly subtract DA - DM. 

Since the DM values that we use are now larger than in 
T04b, the DA values are smaller, and the changes are most 
at the lowest 2 a bs- 

Although we have improved upon T04b, we do not have 
a definitive measurement of DM. Three issues remain. First, 
we extrapolate in A r well beyond the limit of the data. Sec- 
ond, we use all the metal lines listed in SBS88, without 
regard for the equivalent width. Their SNR was approxi- 
mately constant with wavelength in the relevant wavelength 
range, other than an increase in the N V emission line. Since 
their spectra do not have the resolution or SNR to see weak 
lines, the DM values we obtain from their spectra will be too 
small, and our DA too large. Third, our masking the lines 
of LLS may leave too few metal lines compared to the DM 
from SBS88. This error would make our DA too small. We 
masked all the metals from one LLS in most QSOs. These 
QSOs were selected because they contained these LLS, and 
hence we expect that they would have excess metals if wc 
did not apply this mask. However, some of a random sample 
of QSOs would have LLS by chance, and hence we may have 
over corrected. This error will tend to cancel that from the 
numerous weak metal lines missed from the SBS88 line lists. 

As a sanity check, we measured the amount of (un- 
masked) metal absorption in the six of our spectra that 
have significant coverage redward of the Lya emission line. 
In those six spectra we measured the mean metal absorp- 
tion over the observed wavelengths that correspond to the 
Lya forest between 2.2 < z < 3.2 to be 2.1%. This value 
likely has large errors associated with it because it has been 
measured from only six QSOs, but it does increase our confi- 
dence the our general metal line removal based on the results 
of SBS88 is not wildly inaccurate. 



5.3 Measurement of mean DA in Az — 0.1 spectral 
segments 

After masking targeted Deuterium systems and LLS with 
obvious Lya lines, we measured the mean flux in spectral 
segments of Az — 0.1. We started at a rest wavelength of 
1070 A (or the lowest wavelength with data in cases of in- 
complete spectral coverage) in each QSO, and computed the 
mean flux of all segments that are fully contained between 
the rest wavelengths of 1070 and 1170 A. There are typically 
three Az = 0.1 segments in an individual QSO spectrum. 
We discard incomplete segments and any segment with more 
than 10% of it's flux masked for any reason, e.g. a DLA in 
a spectrum will cause at least one, and frequently two seg- 
ments in a given QSO spectrum to be discarded. Finally, 
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Figure 4. DA as a function of redshift. Each point shows the DA 
measured along a particular line of sight over a path of length 
Az = 0.1. The light triangles are the data from 77 QSOs used 
by T04b (observed total absorption, minus mean absorption by 
Lya of LLS and metals), while the dark diamonds show the new 
data from 24 QSOs from this paper (excluding individual Lya of 
LLS, and minus the mean metal absorption). This plot does not 
show part of the data at the higher redshift end of each spec- 
trum because we do not show bins that are partly sampled by a 
spectrum. 



we subtracted the anticipated metal absorption from each 
segment, as described in H5.2I 

Our results are shown in Figure 0] where we also show 
the results for the Kast spectra from T04b. Figure 0] shows 
only the absorption of the low column density Lya forest 
- we have attempted to remove the Lya of all LLS and 
all metal line absorption for all the Kast and HIRES spec- 
tra. For both the HIRES and Kast spectra we subtracted 
the same mean amount of metal absorption from each Kast 
point. For the Lya of the LLS we subtracted the mean for 
all the Kast points, but we masked individual Lya lines for 
the HIRES points. 



5.4 DA as a function of redshift 

To tabulate the mean DA as a function of redshift, we binned 
the data shown in Figure^Jinto redshift bins of width Az = 
0.2. We estimated the mean DA of each bin to be simply 
the mean value of the points in the bin. We estimated the 
error to be the standard deviation of all the points (sec ^15 .51 
we compute the standard deviation from the best power law 
fit to the data) divided by the square root of the number 
of points in each bin. Using the standard deviation of all 
points instead of the standard deviation of just the points 
in each bin gives nearly identical results for bins with large 
numbers of points, but seems to be much better behaved for 
bins with small numbers of points. Our results are in Table 
|2| and shown in Figure 

DA as a function of z is well fit by a power law of the 
form A(l + z) J . Minimizing x 2 to the points in Table|5|gives 
A = 0.0062 and 7 = 2.75. The X 2 of the best fit is 8.69 and 
the reduced \ 2 f° r 7 degrees of freedom (9 data points - 2 
parameters) is 1.24. 

The dashed lines in FigureQ]enclose the Ha confidence 
interval fits. They are produced by taking the envelope that 
contains all power law fits with \ 2 < Xmin + 2.3. Thus the 
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Figure 5. DA as a function of redshift. Here we have binned the 
data points shown in Figure El into bins of Az = 0.2. The solid 
line shows the minimum x 2 fit of the function A(l + z) 7 . We find 
A = 0.0062 and 7 = 2.75 give \ 2 = 8.69 for seven degrees of 
freedom. The dashed lines show the ±1<t confidence interval on 
the fit. 



Table 2. Measured IGM DA values in Az = 0.2 redshift bins 
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0.0074 
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0.250 


0.016 


0.2417 


0.0101 


3.0 


0.252 


0.015 


0.2783 


0.0139 


3.2 


0.338 


0.024 


0.3183 


0.0187 



plotted error bounds are not power laws, but each point on 
the error curves corresponds to a point on a power law that 
fits our data. The last column in Table[5]gives the difference 
between the bounds divided by two. 

We do not give errors for A or for 7. The A - 7 \ 2 
manifold is complex, and it is not well approximated by only 
two numbers (a for A and 7). Attempts to do so in the pas t 
JSteidel fc Sargentll987l : lPress et alll993tlKim et al.l200ll) . 
have lead to all s orts of confusion i n th e literature - con- 
sider t he efforts of lSeliak etafl <|2003f ) and lMeiksin fc White! 
fe004t) to determine the allowed values of r e £f at various red- 
shifts. We recommend use of the results given in Table [5] 

Note that the small dip in DA that we observed at z > 
2.2 in Fig. 22 of T04b is not present in the new HIRES 
data. The combined HIRES + KAST data seems to be well 
fit by a single power law, and no significant deviations from 
a power law are present in our data. 

5.5 Dispersion of DA in Az — 0.1 spectral 
segments 

The new points from this work show less dispersion than 
the points in T04b. This is consistent with the fact that we 
have removed LLS absorption before calculating the mean 
flux in each point, while T04b calculated the mean flux in 



each point with the LLS present, and then subtracted the 
LLS absorption statistically. While both results will give the 
same mean value for the H I Lya forest opacity, the T04b 
method will include the substantial dispersion of the LLS 
absorption. 

The standard deviation of the HIRES DA points (each 
covering Az — 0.1) about the mean given by the power law 
fit is d D A = 5.2±° b 4 % over redshifts 2.2 < z < 3.2. This 
<tda value includes the intrinsic variance of the Lya forest, 
the variance of metal line absorption (we removed the mean, 
not the individual metal absorption) , and the variance of our 
continuum fitting errors. It should not include a significant 
contribution from LLS absorption, since we masked the Lya 
absorption associated with LLS before measuring any DA 
values. 

We can subtract variances (squares of standard devia- 
tions) to estimate the standard deviation of the absorption 
by Lya from the low density IGM alone. As in T04 §9, we 
work with mean values in segments of length Az = 0.1. We 
now repeat the calculations given in T04, considering only 
the HIRES spectra. We take the standard deviation of the 
metal absorption as 3.7 %, where we have scaled the value 
3.1 % in Table 4 of T04b by the mean metal absorption 
which is now DM = 2.76 %, up from 2.3 %. We also use 
the standard deviation of the continuum fitting errors 1.2 % 
O- We find that the intrinsic variation of the mean amount 
of absorption in the Lya forest over Az = 0.1 segments is 
a(Az = 0.1) = 3.4i~}' 2 %. This value is a mean from the 
whole z range, centered near z = 2.7. At z = 2.7 the mean 
total DA per segment, including metals but not Lya lines of 
LLS, is 0.246, and after subtracting the metals it drops to 
0.2246. 

The a(Az = 0.1) value from HIRES spectra agrees with 
the value that we calculated in T04b (section 9.4) for Kast 
spectra: a(Az = 0.1) = 3.9±£y % at z = 1.9. The error is 
larger now, because we have fewer DA measurements giving 
a larger error on the measurement of the standard deviation 
of the DA values. We expect that a(Az — 0.1) will increase 
with increasing z because the power spectrum o f the flux in 
the Lya forest increases with increasing redshift l|Croft et alJ 
l2002t iMcDonald et aljl2004h . We do not see this, but this 
may be because our measurement errors are large and not 
well determined. In T04b we did not subtract the continuum 
fitting error because it appeared to be small, and was not 
well determined. We found contradictory evidence that the 
continuum fit error might be large, in which case the <r( Az = 
0.1) value should be less than the 3.9to.r %• 

We conclude that 24 QSOs is adequate to get the mean 
DA, but we would prefer far more QSOs to obtain an accu- 
rate measurement of the variance in the DA. 



6 DISCUSSION 

Our DA results are in general ag reement with the values 
of the literature summary given in iMeiksin fc White! <2004 
Table Bl). However, we find approximately 0.03 less absorp- 
tion at all redshifts. This is consistent with the fact that we 
have attempted t o measure only the absor ption due to the 
Lya forest, while IMeiksin fc White! <|2004h gave values for 
all absorption in the Lya forest region of a spectrum. 

At z = 2.2, our results are also consistent with 
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ISchave et alj (120031) . who also attempted to measure only 
the absorption associated with the Lya forest. They only 
removed metals absorption they could identify directly in 
the absorption spectra, so their removal completeness is un- 
known, and is probably a function of redshift. However, we 
find a shallower redshift evolution and less absorption at 
z = 3.0. 

The best fit value of DA = 0.278 at z = 3.0 is lower than 
we expected to find when we started this work. In T04b and 
J05 we developed a concordance model of the Lya forest at 
z = 1.9 - this model is referred to as model "A" in T04b 
and J05. Model A uses a uniform UVB with the shape and 
redshift evolution du e to|fIaardt fc Mada ul <|200lf). and dis- 
played graphically in lPaschos fc Normanl (120051) . Model A, 
while giving the measured value of DA at z = 1.9, pre- 
dicts DA = 0.34 at z = 3. The clear implication is that 
there are more ionizing photons at z — 3 than predicted by 
lHaardt fc Madaul l)200lF) . J05 showed that the naive expec- 
tation that r c ff scales like the H I ionization rate is valid 
at z = 2. Assuming that this result holds at z = 3, and 
translating DA into r c g, we find an H I ionization rate 
of r_i2 = 1.3 rfc 0.1, o r 1.3 times the value predicted by 
lHaardt fc Madaul feOOlT) . The error comes from propagating 
the observed error on DA through the J05 scaling relation. 
The real error is likely to be larger, because there is some 
disagreement as to the scaling r elationship between F and 
T off . While J05 found F oc r eff ~\ IBolton et all J2005I) found 
T oc Tea" 1 - 44 at z = 2. iBolton et alj J2005I) also found some 
change in redshift, w ith T oc T e $ at z = 3. If we use the 
IBolton et al.1 (120051) z — 3 relationship instead of the J05 
scaling relation, we instead find F_i2 = 1.5. 

Irrespective of the precise value of F, this data seems to 
indicate that it is larger than expected. It will be interesting 
to try to find the source of these extra photons. 
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